Search for: All records

How to select between policies and value functions produced by different training algorithms in offline reinforcement learning (RL)—which is crucial for hyperparameter tuning—is an important open question. Existing approaches based on off-policy evaluation (OPE) often require additional function approximation and hence hyperparameters, creating a chicken-and-egg situation. In this paper, we design hyperparameter-free algorithms for policy selection based on BVFT [XJ21], a recent theoretical advance in value-function selection, and demonstrate their effectiveness in discrete-action benchmarks such as Atari. To address performance degradation due to poor critics in continuous-action domains, we further combine BVFT with OPE to get the best of both worlds, and obtain a hyperparameter-tuning method for Q-function based OPE with theoretical guarantees as a side product. 

Mechanical properties are fundamental to structural materials, where dislocations play a decisive role in describing their mechanical behavior. Although the high-yield stresses of multiprincipal element alloys (MPEAs) have received extensive attention in the last decade, the relation between their mechanistic origins remains elusive. Our multiscale study of density functional theory, atomistic simulations, and high-resolution microscopy shows that the excellent mechanical properties of MPEAs have diverse origins. The strengthening effects through Shockley partials and stacking faults can be decoupled in MPEAs, breaking the conventional wisdom that low stacking fault energies are coupled with wide partial dislocations. This study clarifies the mechanistic origins for the strengthening effects, laying the foundation for physics-informed predictive models for materials design. 

Super-resolution microscopy is broadening our in-depth understanding of cellular structure. However, super-resolution approaches are limited, for numerous reasons, from utilization in longer-term intravital imaging. We devised a combinatorial imaging technique that combines deconvolution with stepwise optical saturation microscopy (DeSOS) to circumvent this issue and image cells in their native physiological environment. Other than a traditional confocal or two-photon microscope, this approach requires no additional hardware. Here, we provide an open-access application to obtain DeSOS images from conventional microscope images obtained at low excitation powers. We show that DeSOS can be used in time-lapse imaging to generate super-resolution movies in zebrafish. DeSOS was also validated in live mice. These movies uncover that actin structures dynamically remodel to produce a single pioneer axon in a “top-down” scaffolding event. Further, we identify an F-actin population – stable base clusters – that orchestrate that scaffolding event. We then identify that activation of Rac1 in pioneer axons destabilizes stable base clusters and disrupts pioneer axon formation. The ease of acquisition and processing with this approach provides a universal technique for biologists to answer questions in living animals. 

Abstract We explore the decay of bound neutrons in the JUNO liquid scintillator detector into invisible particles (e.g.,$$n\rightarrow 3 \nu $$ $n\to 3\nu$or$$nn \rightarrow 2 \nu $$ $nn\to 2\nu$), which do not produce an observable signal. The invisible decay includes two decay modes:$$ n \rightarrow { inv} $$ $n\to \mathrm{inv}$and$$ nn \rightarrow { inv} $$ $nn\to \mathrm{inv}$. The invisible decays ofs-shell neutrons in$$^{12}\textrm{C}$$ $_{}^{12}\text{C}$will leave a highly excited residual nucleus. Subsequently, some de-excitation modes of the excited residual nuclei can produce a time- and space-correlated triple coincidence signal in the JUNO detector. Based on a full Monte Carlo simulation informed with the latest available data, we estimate all backgrounds, including inverse beta decay events of the reactor antineutrino$${\bar{\nu }}_e$$ ${\overline{\nu }}_e$, natural radioactivity, cosmogenic isotopes and neutral current interactions of atmospheric neutrinos. Pulse shape discrimination and multivariate analysis techniques are employed to further suppress backgrounds. With two years of exposure, JUNO is expected to give an order of magnitude improvement compared to the current best limits. After 10 years of data taking, the JUNO expected sensitivities at a 90% confidence level are$$\tau /B( n \rightarrow { inv} ) > 5.0 \times 10^{31} \, \textrm{years}$$ $\tau /B(n\to \mathrm{inv})>5.0\times {10}^{31}\text{years}$and$$\tau /B( nn \rightarrow { inv} ) > 1.4 \times 10^{32} \, \textrm{years}$$ $\tau /B(nn\to \mathrm{inv})>1.4\times {10}^{32}\text{years}$. 

Abstract The core-collapse supernova (CCSN) is considered one of the most energetic astrophysical events in the universe. The early and prompt detection of neutrinos before (pre-SN) and during the supernova (SN) burst presents a unique opportunity for multi-messenger observations of CCSN events. In this study, we describe the monitoring concept and present the sensitivity of the system to pre-SN and SN neutrinos at the Jiangmen Underground Neutrino Observatory (JUNO), a 20 kton liquid scintillator detector currently under construction in South China.The real-time monitoring system is designed to ensure both prompt alert speed and comprehensive coverage of progenitor stars. It incorporates prompt monitors on the electronic board as well as online monitors at the data acquisition stage.Assuming a false alert rate of 1 per year, this monitoring system exhibits sensitivity to pre-SN neutrinos up to a distance of approximately 1.6 (0.9) kiloparsecs and SN neutrinos up to about 370 (360) kiloparsecs for a progenitor mass of 30 solar masses, considering both normal and inverted mass ordering scenarios.The pointing ability of the CCSN is evaluated by analyzing the accumulated event anisotropy of inverse beta decay interactions from pre-SN or SN neutrinos. This, along with the early alert, can play a crucial role in facilitating follow-up multi-messenger observations of the next galactic or nearby extragalactic CCSN. 

Abstract The Jiangmen Underground Neutrino Observatory (JUNO), the first multi-kton liquid scintillator detector, which is under construction in China, will have a unique potential to perform a real-time measurement of solar neutrinos well below the few MeV threshold typical of Water Cherenkov detectors. JUNO's large target mass and excellent energy resolution are prerequisites for reaching unprecedented levels of precision. In this paper, we provide estimation of the JUNO sensitivity to⁷Be,pep, and CNO solar neutrinos that can be obtained via a spectral analysis above the 0.45 MeV threshold. This study is performed assuming different scenarios of the liquid scintillator radiopurity, ranging from the most optimistic one corresponding to the radiopurity levels obtained by the Borexino experiment, up to the minimum requirements needed to perform the neutrino mass ordering determination with reactor antineutrinos — the main goal of JUNO. Our study shows that in most scenarios, JUNO will be able to improve the current best measurements on⁷Be,pep, and CNO solar neutrino fluxes. We also perform a study on the JUNO capability to detect periodical time variations in the solar neutrino flux, such as the day-night modulation induced by neutrino flavor regeneration in Earth, and the modulations induced by temperature changes driven by helioseismic waves.